AD-A198  789 


I 

Naval  Research  Laboratory 

Washington,  OC  20375-5000 


NRL  Memorandum  Report  6241 


The  BMAP-Tracker  Experiment 

Robert  E.  Srour,  Robert  L.  Lucre  and  John  C.  Kershenstein 

Advanced  Concepts  Branch 
Optical  Sciences  Division 


July  5,  1988 


I 


I 

I 


i 

I 


I 


I 

1 


DTIC 

ELECTE 


Approved  for  public  release;  distribution  unlimited. 


SECURITY  classification  QF  THIS  PAGE 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

0MB  NO  0704-0188 

18.  REPORT  SECURITY  CLASSIFICATION 

UNCLASSIFIED 

lb  RESTRICTIVE  MARKINGS 

2a.  SECURITY  CLASSIFICATION  AUTHORITY 

3  DISTRIBUTION/AVAILA0''.'rY  OF  REPORT 

Approved  for  public  release;  distribucion 
unlimited . 

2b.  DECLASSIFICATION /DOWNGRADING  SCHEDULE 

4.  PERFORMING  ORGANIZATION  REPORT  NUMBERtS) 

NRL  Memorandum  Report  6241 

5.  MONITORING  ORGANIZATION  REPORT  MUMBEP(S) 

6a.  NAME  OF  PERFORMING  ORGANIZATION 

Naval  Research  Laboratory 

6b  OFFICE  SYMBOL 
(If  applicable) 

Code  6521 

7a.  NAME  Of  MONITORING  ORGANIZATION 

6c  ADDRESS  (Ofy,  State,  and  ZIP  Code) 

Washington,  DC  20375-5000 

7b  ADDRESS  (Oty,  State,  and  ZIP  Code) 

8a.  NAME  OF  FUNDING /SPONSORING 
ORGANIZATION 

ONR 

8b  OFFICE  SYMBOL 
(If  applicable) 

9  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBE  = 

Be  ADDRESS  tO'ty,  State,  and  ZIP  Code) 

Arlington,  VA  22217 

10  SOURCE  OF  FUNDING  NUMBERS 

PROGRAM 
ELEMENT  NO 

62111N 

PROJECT 

NO 

RLIB 

TASK 

NO 

WORK  JNIT 
ACCESSION  NO 

11.  TITLE  (Include  Security  Classification) 

The  BMAP-Tracker  Experiment 


12.  PERSONAL  AUTHOR(S) 

Srour,.  R.E.,  Lucke,  R.L.  and  Kershenscein,  J.C. 


13a.  TYPE  OF  REPORT 

13b.  TIME  COVERED 

14  DATE  OF  REPORT  {Year,  Month.  Day) 

15  PAGE  COUNT 

FROM  6/86  TO  3/88 

1988  July  5 

18 

16.  SUPPLEMENTARY  NOTATION 


1  17  COSATI  COOES  | 

FIELD 

GROUP 

SU0.GROUP 

18  SUBJECT  TERMS  {Continue  on  reverse  if  necessary  and  identity  by  block  number) 


1 


abstract  {Continue  on  reverse  if  necessary  and  identify  by  block  number) 

— The  infrared  sensor  used  in  the  -Navy^ Background  Measurements  and  Analysis  Program  ( BMAP)  was 
mounted  on  an  optical  tracker  at-ihe 'NavaHlesearch  Laborawr^o  monitor  commercial  aircraft  entering  and 
leaving  National  airport.  The  experiment  demonstrated  the  capabilities  of  the  tracker-sensor  combination  and 
generated  data  that  were  used  to  test  a  Fourier  technique  for  frame  registration.  The  technique  is  shown  to  be 
effective  in  preparing  data  for  a  frame  differencing  signal  processor  to  detect  moving  targets. 


:0  DISTRIBUTION/ availability  'OF  ABSTRACT 

CSUNCLASSIFIED/UNUIMITED  □  SAME  AS  RP^  Q  qtiC  USERS 

abstract  •'ECJRI''''  ''.asSimCATuin 

UNCLASSIFIED 

22a  NAME  OF  pESPONSIBLE  'NDIVIDUAL 

Robert  E.  Srour 

22b  ’ELc  PHONE  i/nc?uc/e  Pfpj  Cjtjpi  '  . ..  c  t  i 

''202>  '  L-do  "V' 

00  Form  1473.  JUN  36 


eoffionx  arc  oosolerc 


..S',.- 


— « 


CONTENTS 


1)  Introduction 


2)  Equipment  Description 


3)  Phase  Correlation  Approach  to  Picmre  Registration 


4)  Frame  Difference  Analysis 


S)  Conclusion 


!  lO.  i 

( _ _ 


;  ''"io 


\ft-i 


W 

V  'V‘ 


W 

<■: 


WMf 

m 


I 


^S'.: 


^K’^.'^N'Cv’CN'Ov'iy.'CN’'' 


THE  BMAP-TRACKER  EXPERIMENT 


1)  Introduction 

- One  goal  of  the  Background  Measurements  and  Analysis 

Program  (BMAP)  is  to  generate  an  infrared  (IR)  database  for 
testing  IR  target  detection/clutter  rejection  algorithms.  The 
BMAP  radiometer  has  been  deployed  on  ground-based  and  air¬ 
borne  platforms  to  collect  a  wide  variety  of  IR  data."^  ___ 

In  this  experiment  the  BMAP  radiometer  was  installed  on 
an  NRL-developed  optical  tracker  to  observe  aircraft  entering 
and  leaving  National  Airport.  The  exercise  generated  a  set  of 
radiometric  aircraft  signatures  against  real  backgrounds  with 
accurate  aircraft  range  and  heading  information  provided  by 
the  FAA.  The  data  have  been  used  to  test  a  frame  registration 
and  frame  differencing  algorithm. 

2)  Equipment  Description 

The  optical  tracker  (Figure  1)  is  an  elevation-gimbaled , 
0.8  meter  telescope  mounted  on  a  rotatable  base.  It  uses  TV 
cameras  (shown  in  Figure  1)  and  video  signal  processing  to 
track  a  moving  target.  Table  1  lists  the  tracker's  capabil¬ 
ities. 

The  BMAP  sensor  (owned  by  Raytheon  Co.  and  operated 
under  contract  by  the  Navy)  is  a  dual-band,  calibrated,  scan¬ 
ning  radiometer.  It  uses  refractive  optics  and  two  16-element 
linear  detector  arrays  to  cover  the  3-5/y  (MWIR)  and  8-12^; 
(LWIR)  spectral  regions.  Detailed  specifications  for  the 
sensor  are  shown  in  Table  2.  The  sensor  forms  an  imaae  (in 
each  waveband)  by  scanning  -.he  detector  arrays  horiscntaily 
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across  the  scene.  Detector  elements,  stacked  vertically,  form 
16  horizontal  lines  per  image.  The  detectors'  outputs  are 
sampled  3.44  times  per  dwell,  substantially  exceeding  the 
nominal  Nyquist  rate  of  twice  per  dwell,  appropriate  for 
matched  optics  (i.e.,  the  blur  circle  diameter  equals  the 
detector  width).  Note  that  the  vertical  direction  is  under¬ 
sampled  by  a  factor  of  two  because  the  detector  elements  do 
not  overlap. 

For  this  experiment,  the  BMAP  sensor  was  mounted  in  the 
telescope  barrel  of  the  tracker  and  boresighted  to  the  video 
cameras  (Figure  1).  The  tracker  and  sensor  were  located  at 
the  southwest  corner  of  NRL  from  June  9  to  July  10,  1986. 
Measurements  were  made  on  several  days,  but  only  on  one  day, 
July  3,  were  data  recorded  of  aircraft  in  highly  structured 
(therefore  interesting)  cloud  background  scenes.  A  total  of 
1937  frames  of  data  were  recorded  on  this  day  between  1233 
and  1428  hours,  tracking  11  departing  flights.  The  aircraft 
were  headed  north  on  takeoff,  then  turned  west  and  south. 

3)  Phase  Correlation  Approach  to  Picture  Registration 

The  tracker  data  were  used  to  test  a  frame  registration 
and  differencing  algorithm.  Frame  differencing  (subtracting 
one  picture  from  another,  pixel  by  pixel)  is  an  effective 
target  discriminator  when  a  sequence  of  pictures  contains  a 
target  that  moves  with  respect  to  a  motionless  background 
scene  because  only  pixels  containing  the  target  are  non-zero 
in  the  difference  frame.  When  the  background  moves  during  the 
picture  sequence,  the  pictures  '.lUSt  be  aligned  with  respect 
to  the  background  features  (picture  registration;  before 
computing  the  difference. 

The  algorithm  used  :o  compute  the  iii sal i  gnment  cf  me 
scene  between  two  pictures,  phase  correlation,  exploits  the 
fact  that  the  displacement  of  the  scene  can  be  determined 


from  the  phase  of  the  cross  power  spectrum  of  the  pictures.^ 
(An  extensive  analysis  of  phase  correlation  can  be  found  in 
reference  [ 3 ] . ) 

The  phase  correlation  matrix,  d,  is  computed  for  two 
pictures,  g^,  92  from  the  following  equation: 

^1^2* 

d  -  F-1  |GiG2*I 

two  dimensional  FFT  of  image  g^^ ,  i  =  l,2 
complex  conjugate  of  G^ 
inverse  Fourier  transform 

When  gi  and  92  are  pictures  of  the  same  scene,  but  are  mis¬ 
aligned  by  (m,n)  samples,  the  phase  indicator  function  (the 
surface  defined  by  the  values  in  the  d  matrix)  forms  a  peak 
at  the  (m,n)  element  in  d.  If  g^  and  92  are  aligned,  there 
will  be  a  peak  at  (0,0).  For  partially  overlapping  pictures, 
the  phase  indicator  has  many  non-zero  values  (noise)  and  a 
diminished  registration  peak.  Phase  correlation  will  mis- 
register  pictures  if  the  noise-produced  peaks  are  larger  than 
the  registration  peak.  Peak  height  is  reduced,  for  example, 
when  the  misregistration  between  scenes  is  not  an  integer 
number  of  samples,  and  the  peak  may  be  spread  out  over  as 
many  as  four  elements  in  the  d  matrix.  (The  location  of  the 
peak  is  found  by  searching  for  the  maximum  d-matrix  value  and 
then  interpolating  through  the  maximum  and  neighboring  sam¬ 
ples  with  a  function  of  the  form  (sinx)/x.^  The  registration 
point  is  then  given  by  the  maximum  value  of  the  interpolated 

2. Kuglin  and  Hines,  "The  Phase  Correlation  Image  Alignment 
Method",  Proceedings  of  the  1975  Int.  Conf.  on  Cybernetics, 
tIEEE),  1975 

3.  McHugh,  Schaum,  "New  Methods  of  Image  Registration", 
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curve.)  Other  effects  that  can  cause  reduced  peak  heignt  or 
false  pea)(s  are  discussed  below. 

A  scanning  sensor  produces  a  frame  of  data  by  scanning 
the  detector{s)  across  the  scene  with  a  scan  mirror,  ir.  a 
tracker/scanner  system,  the  effective  scan  rate  of  the  scan¬ 
ner  is  the  sum  of  the  scan  mirror's  intrinsic  rate  and  the 
component  of  the  tracker's  angular  rate  in  the  scan  direc¬ 
tion.  Any  variation  in  the  tracker's  angular  rate  between 
frames  (or  during  a  frame)  will  change  the  size  of  the  sen¬ 
sor's  footprint,  making  scene  features  appear  to  be  stretched 
or  compressed  from  frame  to  frame.  Spatial  distortions  of 
this  type  cause  different  parts  of  the  scene  to  move  by  diff¬ 
erent  amounts  between  frames.  This  can  confuse  phase  correla¬ 
tion  which  is  only  good  for  measuring  rigid  translations  of 
scene  features.  Stretching  of  the  scene  by  several  samples  in 
the  scan  direction  was  observed  in  some  of  these  data,  resul¬ 
ting  in  poor  performance  of  the  registration  algorithm.  In  an 
operational  tracker/scanner  combination,  the  tracker's  rate 
may  need  to  be  integrated  into  the  scanning  rate  of  the  sen¬ 
sor  to  avoid  these  spatial  distortions. 

Another  problem  arises  from  the  way  Fourier  analysis 
treats  a  function  defined  only  over  a  finite  domain.  Phase 
correlation,  based  on  the  Discrete  Fourier  Transform,  assumes 
that  each  frame  of  data  under  consideration  is  one  complete 
cycle  of  an  infinitely-extended  function.  If,  for  example, 
the  left  side  of  a  scene  has  a  substantially  higher  intensity 
than  the  right  side,  the  result  is  a  cyclic  Fourier  function 
with  a  jump  discontinuity.  Since  this  jump  does  not  move  from 
one  picture  to  the  next  (it  is  always  at  the  edge),  the  phase 
indicator  function  registers  a  peak  at  (0,0)  (in  addition  to 
the  real  registration  peak)  indicating,  erroneously,  that 
there  was  no  scene  shift  between  pictures. 


This  problem  is  dealt 
data  with  a  function  that 
the  "Fourier  scene"  without 
interior  of  the  picture 
demonstrates  the  method 
dimension : 


with  by  multiplying  the  picture 
removes  the  edge  discontinuity  in 
disturbing  the  structure  in  the 
(see  reference  3).  Figure  1 
employed,  simplified  to  one 


Figure  1 


where: 

R(x)  -  scene  radiance  with  mean  removed 
n  *•  number  of  samples  across  a  frame 

L  »  number  of  samples  used  for  smoothing 

w^  -  ,5  *  (  1  -  cos(iii/L)  ),  i  =  0,l,...L 

W2  ■  .5  *  (  1  -  cos((N-i)ii/L)  )  ,  i  *  n-L,...  n 

If  the  one  dimensional  scene,  R(x),  is  featureless  except  for 
a  step  somewhere  near  the  middle  of  a  frame,  there  is  a  dra¬ 
matic  intensity  difference  between  left  and  right  edges.  When 
phase  correlation  is  applied  to  two  pictures  sampled  from 
this  scene,  the  phase  indicator  function  will  have  two  peak 
values  of  equal  intensity,  one  corresponding  to  the  displace¬ 
ment  of  the  central  feature  between  the  two  frames,  and  an¬ 
other,  showing  no  displacement,  caused  oy  the  intensity  diff¬ 
erence  between  left  and  right  edges.  Since  the  peaks  are  of 
equal  intensity,  phase  correlation  has  no  way  of  iiscriminat- 
ing  the  real  registration  peak  from  the  artifact.  Using  the 
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modified  scene,  R(x)*w,  the  amplitude  of  the  edge-produced 
peak  is  less  than  the  registration  peak,  allowing  the  regis¬ 
tration  point  to  be  found  unambiguously.  The  extent  to  which 
this  "edge-effect  peak"  is  removed  is  a  function  of  L,  the  j 

number  of  samples  affected  by  the  weighting  function,  and 
must  be  optimized  so  that  the  weighting  will  not  alter  fea¬ 
tures  over  too  large  a  part  of  the  scene.  The  values  L  =  2  in 
the  vertical  direction  (n  -  16),  and  L  »  58  in  the  horizontal  I 

direction  (n  -  360)  worked  well  for  these  data. 

Another  problem  arises  when  phase  correlation  tries  to 
determine  large  displacements  (more  than  half  a  picture) 
between  two  pictures.  For  two  pictures  with  n  x  m  picture  I 

elements  (pixels)  each,  there  are  2n  x  2m  distinct  shifts  in  f 

scene  content  that  could  occur  between  the  two:  the  common 
scene  element  in  the  first  picture  might  be  shifted  anywhere 
from  0  to  +n  X  +m  pixels  in  the  second.  However,  the  phase 
indicator  function  has  only  n  x  m  unique  values  because  there 
are  only  n  x  m  unique  cyclic  shifts  in  the  Fourier  scene.  For 
non-cyclic  shifts  the  phase  indicator  function  is  ambiguous. 

A  peak  at  the  i*^^  element  could  mean  a  shift  of  i  samples  in 
one  direction  or  (n-i)  samples  in  the  opposite  direction.  To 
avoid  this  ambiguity  the  size  of  each  picture  analyzed  is 
made  four  times  as  large  as  the  original  picture  by  stitching 
each  picture  onto  itself  -right  edge  to  left  and  top  to  bot¬ 
tom  (after  the  edge-smoothing)-  producing  a  phase  indicator 
that  can  uniquely  describe  2n  x  2m  shifts.  This  method  is 
simple  and  effective  but  somewhat  more  computer-intensive 
than  an  iterative  approach  described  in  reference  3. 


4)  Frame  Difference  Analysis 

Once  phase  correlation  determines  the  amount  of  image 
misalignment,  the  pictures  must  be  realigned  by  that  amount 
before  computing  their  difference.  In  general,  this  requires 
both  a  whole  numoer  sample  shift  and  a  fractional  shift.  To 
do  the  fractional  snift,  it  is  necessary  to  reconstruct  the 
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scene  between  samples.  Linear  interpolation  between  adjacent 
samples  in  the  scan  direction  is  fairly  accurate  because  the 
data  are  oversampled  in  that  direction.  In  this  paper  we  are 
not  overly  concerned  with  sub-pixel  registration  accuracy,  so 
linear  interpolation  in  the  vertical  (cross-scan)  direction 
is  adequate  even  though  the  vertical  direction  is  under- 
sampled.  A  more  complicated  method  such  as  cubic  convolution 
(also  discussed  in  reference  3)  could  be  used  to  improve  the 
accuracy  of  sub-pixel  reconstruction,  especially  in  the 
cross-scan  direction. 


The  frame  registration-frame  differencing  algorithm 
described  above  was  run  in  a  "hands  off"  mode  on  several 
sequences  of  tracker  data  with  the  results  shown  in  Figures 
3-7.  In  each  figure  there  are  four  greyscale  images  generated 
on  an  8  bit  Gould/Deanza  image  processor.  The  two  input  data 
frames  are  shown  at  the  top  of  each  figure  with  IRIG  time 
(day:  hour:  minute:  second)  displayed  above  the  frame  and  the 
identifying  frame  number  and  IR  band  (MW,LW)  on  either  side. 
The  third  image  is  that  part  of  the  second  frame  (resampled) 
that  is  in  common  with  the  first.  The  last  image  shows  the 
absolute  value  of  the  difference  frame.  The  absolute  value  is 
used  for  display  purposes  so  that  a  zero  in  the  difference 
equals  black  (not  grey).  The  greyscale  range  is  self-scaled 
in  each  image  to  emphasize  details  of  the  scene  structure. 
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strong  background  clutter  in  the  difference  frame  is  a  result 
of  the  scene  stretching  discussed  in  section  3.  This  causes 
the  sharp  edges  of  the  background  structure  to  "leak"  through 
the  differencing  processor.  Figure  6  demonstrates  phase  cor¬ 
relation's  ability  to  register  large  offsets  (more  than  half 
a  picture).  In  this  case,  the  background  clutter  in  the  diff¬ 
erence  frame  is  brighter  than  the  aircraft  because  of  scene 
stretching.  (The  aircraft  is  just  emerging  from  the  cloud 
edge  in  frame  307;  vertically  it  is  centered  in  the  picture.) 
Figure  7  demonstrates  phase  correlation's  ability  to  register 
pictures  where  there  is  substantial  scene  motion  in  two  dir¬ 
ections.  Here  again  the  aircraft  appears  in  only  one  frame 
because  it  has  just  emerged  from  behind  a  cloud  and  there  is 
significant  clutter  in  the  difference  frame  due  to  scene 
stretching. 

5)  Conclusion 

The  tracker  experiment  demonstrated  the  operation  of 
NRL's  tracker-sensor  combination  and  produced  an  IR  data  set 
useful  in  evaluating  target-background  discrimination  tech¬ 
niques.  Tracker  accelerations  that  occurred  while  taking  data 
caused  distortions  in  the  scene  beween  frames.  In  an  opera¬ 
tional  tracker-sensor  system,  the  tracker's  rate  should  be 
coupled  to  the  scan  mirror's  intrinsic  scan  rate  to  avoid 
these  distortions. 

A  frame  registration  and  frame  differencing  algorithm 
was  tested  using  the  tracker  data  set.  The  results  show  that 
it  is  possible  to  register  pictures  using  phase  correlation, 
even  for  very  large  scene  offsets,  when  the  scene  moves 
rigidly  between  pictures,  phase  correlation  is  an  effective 
precursor  to  a  frame  differencing  signal  processor. 


FIGURE  2 

The  optical  tracker  shown  with  the  BMAP  sensor  mounted  inside  the 
telescope  barrel.  The  video  cameras  used  for  tracking  are  housed 
in  pods  to  the  right  of  the  gimbal  axis. 


FIGURE  3 

Aircraft:  Boeing  737,  Altitude:  5300  feet.  Range:  12  nautical  miles. 
Band:  longwave.  Sample  Offset:  122.5,  Channel  Offset:  0.3 
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